An Interactive Speech Interface for Virtual Characters in Dynamic Environments

In this paper, we propose a new improvement to our 3D Virtual Story Environment System (3DVSE) by adding a real-time animation with voice synthesis. The new system offers a flexible and easy way to generate an interactive 3D virtual Environment (3DVE) as compared to traditional 3D packages. It enables the user to control and interact with the virtual characters via speech instructions so that the characters can respond to the commands in real time. This system has the potential, if combined with artificial intelligence, to act as a dialogue interface for believable agents that have many applications such as computer games, and intelligent multimedia applications. In this system, the agent can talk and listen to fellow agents and human users.